
ADAPTIVE FILTER FOR COMMUNICATION SYSTEM 

BACKGROUND OF THE INVENTION 

(1) Field of the Invention - This invention relates to adaptive systems in the areas of 
communications and control, particularly to a real computation solver for systems of linear 
equations with complex-valued elements. 

(2) Brief Description of Related Art> Adaptive filtering is widely used in communication 
systems to optimize the reception of signals. A sample of such a system was described in a paper 
by A. Klein and P. W. Baier, 'Xinear unbiased data estimation in mobile radio systems applying 
CDMA" IEEE Journal on Selected Areas in communications, vol. 1 1 , pp. 1 058- 1 066, 1 993 . In the 
areas of adaptive filtering, parameter estimation and system identification, linear prediction 
provides the means for adapting linear systems to a set of measurements or observations. The 
parameters required to perform this adaptation are extracted by solving overdetermined systems 
of linear equations of the desired system adaptation parameters, the elements of which are usually 
complex-valued. In general, a system of linear equations can be represented by the equation 



where the measurements or observations are arranged in the matrix X of dimensions NxM, the 
vector d of length N contains a known or estimated sequence and a is the vector of length M with 
the desired system adaptation parameters. Among the possible methods for solving such systems 
of linear equations, the solution in the least squares sense , termed as Least Squares Solver 
(LESS) fi*om now on, is the most widely used. Special cases of LESS are the well-known Least 
Mean Squares (LMS) as described by S. Haykin in Adaptive Filter Theory, Prentice Hall, 2"*^ Ed., 
pp.67-68, 1994, Recursive Least Squares (RLS) as described by E. Frantzeskakis and K.J.R.Liu, 
in "A Class of Square Root and Division Free Algorithms and Architectures for QRD-Based 
Adaptive Signal Processing", IEEE Trans. On Signal Processing, volt,42, no.9, pp. 2455-2469, 
Sept. 1994, and the Householder algorithms as described by K.J.R., S.F. Hsien and K. Yao in 



"Systolic Block Householder Transformation for RLS Algorithm Avith Two-Level Pipelined 
Implementation", IEEE Trans, On Signal Processing, Vol.40, No.4, pp.946-958, April 1980. 

However, the application of LESS is computationally complex. It is desirable to reduce the 
computational complexity without sacrificing performance, stability or convergence rate. 
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SUMMARY OF THE INVENTION 

An object of this invention is to reduce the complexity in implementing an adaptive filter. 
Another object of this invention is to reduce the computational complexity without sacrificing 
performance, stability and convergence. 

These objects are achieved by a three step method for applying a LESS that enables a 
significant reduction of the computational complexity. In a first step, this method uses Lee's 
transformation , denoted herein as linear binary orthogonalization transformation (BOT), fi-om 
complex number arithmetic to real number arithmetic. In a second step, two real computation 
LESS are applied. In a third step, an inverse BOT (IBOT) fi-om real number arithmetic to 
complex number arithmetic is introduced. The IBOT is the counterpart of Lee's BOT and its 
output provides the desired complex-valued system adaptation parameters. Concerning the first 
step of the method, i.e. the introduction of the BOT, two types of BOT are proposed: The first 
one relies on Lee's transformation as described in A.Lee, "Centrohermitian and skew- 
centroheritian matices". Linear Algebra and its Applications, volt 29, pp.205-210, 1980 and 
maps a complex-valued matrix of dimensions NxM onto two real-valued matrices, each of 
dimensions NxM. The second type of the BOT produces fi^om a complex-valued matrix of 
dimensions NxM two real-valued matrices, each of dimensions NxM, by addmg and subtracting 
the real and imaginary parts of the complex-valued matrix, respectively. Concerning the third step 
of the method, i.e. the introduction of the IBOT, two types of IBOT are proposed: The first one 
is the counterpart of the first type of the BOT presented above, while the second type of the 
IBOT is the counterpart of the second type of the BOT presented above. 

Compared to the known method, i.e. the application of a complex computation LESS, the 
proposed technique achieves a significant reduction of the computational complexity without 
sacrificing performance, stability or convergence rate. Therefore, this technique is particularly 
appropriate for implementation of adaptive systems on programmable machines, as well as 
dedicated VLSI architectures in the areas of communications and automation control 

The innovations of this invention are: 

1 Introduction of the IBOT that is the counterpart of the BOT relying on Lee's 
transformation. 



2. Introduction of the BOT produced by adding and subtracting the real and imaginary parts 

of the complex- valued measurements or observations. 
3 Introduction of the IBOT that is the counterpart of the BOT produced by adding and 

subtracting the real and imaginary parts of the complex-valued measurements or 

observations. 

4. Combination of BOT vdth IBOT and real computation LESS in order to implement a 
complex computation LESS. 

5. Application of two LESS in parallel or serially. 

6. Application of these methods for temporal or spatial or joint temporal and spatial channel 
estimation or equalization, for carrier frequency estimation, for Direction Of Arrival 
(DO A) estimation or for joint carrier frequency and DOA estimation. 

The advantages of this invention are: 

1 Reducing the number of operations required for applying a LESS on a programmable 

machine like a Digital Signal Processor (DSP) by up to 50 %. 
2. Reducing the circuit area required for implementing a LESS on VLSI architectures by up 

to 25%. 

3 Enabling the application of a larger size LESS with the available resources, resulting in a 

broadening of the range a LESS can be applied to. 
4. When applying the BOT that relies on Lee's transformation, the accuracy of the desired 

system adaptation parameter estimate is increased due to the inherent forward-backward 

averaging (FBA) feature of this type of BOT. 
Note: The dynamic ranges of the algorithm variables and the convergence characteristics are 
the same with the original complex-valued LESS. 
BRIEF DESCRIPTION OF THE DRAWINGS 

Fig 1 shows the Prior art: Serial complex computation LESS 

Fig.2 shows a Parallel real computation LESS according to the invention 

Fig. 3 A shows the structure of the first type BOT building block 

Fig.3B shows an alternative structure of the first type BOT building block 

Fig.3C shows a structure of the first type BOT 

Fig. 3D shows a structure of the first type IBOT building block 



Fig.3E shows an alternative structure of the first type mOT building block 

Fig.3F shows a structure of the first type IBOT 

Fig.4A shows structure of the second type BOT 

Fig.4B shows a structure of the second type EOT 

Fig. 5 shows a serial real computation LESS according to the invention 

Fig.6 shows a parallel real computation Constrained LESS (CLESS) according to the 

invention 

DETAILED DESCRPTION OF THE INVENTION 
Prior art:- 

Fig. 1 illustrates the prior art in applying a LESS where all computations take place in 
complex number arithmetic. More specifically, the complex-valued input vector x of length M is 
O fed to block 100 representing the serial complex computation LESS that produces at its output 
the complex-valued parameter vector a of length M. In the areas of communications and 
automation control, there might be a need for the recursive updating of the output parameter 
^ vector a depending on a sequence of input vectors x, i.e. there might be a need for adaptive linear 
^ prediction. In this case, block 100 in Fig. 1 represents a LESS of the recursive type like the RLS 
Q algorithm or the LMS algorithm and variations thereof, e.g., computation of the RLS algorithm 
^ by a systolic array or the use of the Householder transformation, the Cholesky decomposition, the 
m Singular Value Decomposition (SVD) as described by S.L. Marple, Jr., in Digital spectral 
P analysis with applications, Prentice-Hall, Englewood, New Jersey, 1 987, or the QR 

Decomposition (QRD). However, there are also cases where the output parameter vector a is 
produced fi-om the input vector x in a non-recursive or blockwise fashion. This situation can be 
described by the direct multiplication of the input vector x with a matrix A, both with the 
appropriate dimensions, and is typical for channel estimation and channel equalization in the areas 
of communications and automation control, seeg] for a representative work. In this case, block ? 
100 in Fig. 1 represents a LESS of the non-recursive or block type, e.g., the Block Matched Filter 
Estimator (BMFE) or the Block Zero Forcing Estimator (BZFE) or the Block Minimum Mean 
Squared Error Estimator (BMMSEE). Summarizing, block 100 in Fig. 1 represents a serial 
complex computation LESS of the recursive or the block type. 
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Description / Derivations:- 

1 Parallel Real Computation LESS (Fig.2): Our objective is to apply a LESS of the 
recursive or the block type by using real number arithmetic throughout, except for an initial BOT 
from complex number arithmetic to real number arithmetic and a final IBOT from real number 
arithmetic to complex number arithmetic. Fig. 2 illustrates the proposed architecture termed 
parallel real computation LESS 200. At first, the BOT 210 is applied to the complex-valued input 
vector X and produces two real-valued output vectors yAand ye. The details of the BOT 210 are 
described in the following Section 2 for the first type and in Section. 3 for the second type of the 
proposed transformations. Then, each one of the real-valued vectors yAand yB is fed to block 220 
representing a LESS, the computations of which exclusively take place in real number arithmetic. 
Note that the two LESS operate in a parallel fashion. Each LESS produces a real-valued output 
O vector denoted as bA and bs, respectively. Then, an IBOT 230 is jointly applied to bA and be so 
,j that the output vector a gives an equivalent result to the output of the serial complex computation 
^ LESS 100 iUustrated in Fig. 1 . The details of the BOT 230 are described in the following Section 
^ 2 for the first type and in the following Section 3 for the second type of the proposed 
^ transformations. 

P 2. BOT and IBOT of the first type (Fig. 3): In this paragraph the details of the BOT 210 and 

^ the mOT 230 of Fig. 2 are explained when the first type of the proposed transformations is used. 

1 y 

y i Consider a complex-valued input vector x of length M, with M being a positive integer. In the 
p, general case where M is odd, i.e. M equals 2k+l with k a non-negative integer, x may be written 
as 



where xi and X2, both of length k, represent the upper and lower part of x and Xc represents the 
central element of x. Certainly, when M is even, the central element Xc should be dropped. Then, 
according to Lee's transformation [2], setting out from x two real-valued vectors yAand ye each 
of length k are produced, the structure of which is in one-to-one correspondence with the 
structure of x, see (2), i.e. 



x = [xj^ X, xjf , 



Ya =|yl.i yA.cyl2r and 




r. 



5 



hss: 

Ul 



m 

in 



The BOT is algebraically expressed by the equations 

= [Re{^^ + x^n, ] V2Re{x^, } Im^^ + x^U, f (4) 

yB = [- Imf^^ x7n, } - V^Im{x^, } Re^f - x^^n, }f , (5) 
where Re{} and Im{} denote the real and imaginary part of their complex argument - a complex- 
valued vector or a complex number - and denotes the kxk exchange matrix having ones on 
its antidiagonal and zeros elsewhere. According to (4) and (5), each element of the real-valued 
output vectors yA,i, yA,2, yB,i, and yB,2 is produced from additions of two elements of the vectors 
xi and X2, see (2). This operation is implemented by BOT A 3 10 shown in Fig. 3 A, where the 
blocks 350 and 355 apply the operators Re{} and Im{} respectively, block 365 represents the 
sign inversion operation and block S 360 stands for the addition operation. Furthermore, the 
central elements of the real-valued output vectors yAand jb are directly extracted from the central 
element of the input complex-valued input vector x. This operation is implemented by BOTE 320 
shown in Fig. 3B, where blocks 350 and 355 apply the operators Re{} and Im{} respectively, 
block 365 represents the sign inversion operation and block 370 is a multiplier with the constant 
quantity ^^2 The application of the first type BOT 211 to the total complex-valued input vector 
X is illustrated in Fig. 3C, where the blocks BOTA 3 10 and BOTE 320 are shown in Fig. 3A and 
Fig. 3B, respectively. 

The counterpart IBOT of the first type BOT is introduced in the foUowing. Let bAand bs 
express two real-valued vectors of length M. According to Fig. 2, these vectors represent the 
output of the two parallel real LESS of the proposed architecture. bAand bs are partitioned 
according to vectors yAand ys produced by the first type EOT, i.e. 

»>A=k.b^,bI,J and b3=[b^,b3.,b^,J. (6) 
If the desired complex-valued output parameter vector a, see Fig. 1, is partitioned as 

a = ka.a^f, (7) 
then the first type IBOT is algebraically expressed by the equations 

a, = (l/V2)[bA , +bB., + j(b^,, -bg,,)] (8) 
a, =(1/V2) n, [b^, -b^,, -j(b^_, +b3,)] (9) 
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ac=bA.c-jbB.c , (10) 
where j denotes the imaginary unit. According to (8) and (9), each element of the real part and the 
imaginary part of the complex- valued vectors ai and 82, see (7), are produced by additions of the 
elements of the vectors bA,i, bA,2 , be,! and bB,2 and multiplications with the constant quantity 
1/ V2 This operation is implemented by IBOTA 330 shown in Fig. 3D, where block 365 
represents sign inversion, block S 360 stands for addition and block 380 expresses the 
multiplication with the constant quantity 1/ V2 . Blocks 385 and 390 represent the creation of a 
complex quantity from its real and imaginary part. Furthermore, the central element acof the 
complex-valued output vector a is directly extracted from the central elements bA,cand bB,c of the 
real-valued input vectors bAand be. This operation is implemented by ffiOTB 340 shown in Fig. 
3E, where blocks 365, 385 and 390 are described above. The first type fflOT 232 producing the 
total complex-valued output vector a is illustrated in Fig. 3F, where blocks IBOTA 330 and 
BBOTB 340 are shown in Fig. 3D and Fig. 3E, respectively. 

3. BOTandlBOTofthe second type (Fig. 4): In this paragraph the details of the BOT 210 
and the IBOT 230 of Fig. 2 are explained when the second type of the proposed transformations 
is used. Consider a complex-valued input vector x of length M, with M being a positive integer. 
Then, two real-valued vectors yA and ys each of length k can be produced from x by adding and 
subtracting the real and imaginary parts of the complex-valued vector x, respectively. This 
operation is algebraically expressed by the equations 

=Re{x}+Im{x} (11) 
ye =Re{x}-Im{x}, (12) 
and its implementation is shown in Fig. 4A (BOT 212), where blocks 350 and 355 apply the 
operators Re{} and Im{} respectively, block 365 represents the sign inversion operation and 
block S 360 stands for the addition operation. 

The counterpart IBOT of the second type BOT is introduced in the following. Let bAand be 
express the two real-valued vectors of length M representing the output of the two parallel real 
LESS of the proposed architecture (see Fig. 2). Then, the IBOT of the second type is 
algebraically described by the equation 

a=(bA+bB)+j(bA-bB) (13) 



where a is the desired complex valued output parameter vector. This operation is implemented as 
shown in Fig, 4B (BBOT 232), where block S 360 stands for addition, block 365 expresses sign 
inversion and blocks 385 and 390 represent the creation of a complex quantity from its real and 
imaginary part. 

4. Serial Real Computation LESS (Fig. 5): In numerous communication apphcations 
periodic or non-periodic training data is used to assist the adaptation process of LESS. This input 
data is fed in bursts of, e.g., length N. Consequently, instead of using two real computation LESS 
in parallel (see Fig. 2), we can adopt a serial architecture employing a single real computation 
LESS. This serial architecture is illustrated in Fig. 5 and is labeled as Serial Real Computation 
LESS 400. After processing the data in BOT 210, the real computation LESS in block 220 is 
serially fed by the vectors yAand ye. In order to enable this serial usage of block 220, the 
combination of a buffer 410 and a Switching Circuit 1 (SWl) 420 is introduced. The buffer 410 
stores a sequence of vectors ye of length N. During this time period, the switch of SWl 420 is in 
the upper position. At the same time, the output vector bAis stored in a buffer 440 with the switch 
of Switching Circuit 2 (SW2) 430 being in the upper position. After the sequence of vectors yA is 
fed to the real computation LESS 220, the switch of SWl 420 is moved to the lower position and 
the sequence of vectors ye is fed to block 220, while the switch of SW2 430 is moved to the lower 
position. The vectors bA and be are simultaneously fed to the IBOT 230, exactly as in Fig. 2. The 
output of the IBOT is the desired complex-valued parameter vector a. Compared to Fig. 2, the 
proposed method in Fig. 4 leads to more cost-effective implementations on DSPs and VLSI 
architectures, since the LESS 220 is a highly demanding part of the system in terms of 
computational complexity and required circuit area. The only penalty in this architecture is a 
processing latency of N input clock cycles. 

5. Parallel Real Computation Constrained LESS (Fig, 6): There are cases in 
communications and automation control where a LESS is applied more than one time, say P 
times, subject to P different constraints. In these cases, from a single observation vector x, P 
different parameter vectors p=l . . .P, are produced. A Constrained LESS (CLESS) usually 
operates with complex number arithmetic. In Fig. 6 we show how our method is extended for 
computing CLESS by using real number arithmetic throughout, except for an initial BOT 210 
from complex number arithmetic to real number arithmetic and P final IBOT 230 blocks from real 



8 



number arithmetic to complex number arithmetic. At the output of each real LESS 220 in Fig. 6 P 

real-valued vectors b^^ and p=l . . P, are produced and are fed to a bank of P IBOT 230 

modules. At the output of each IBOT a specific output parameter vector sl^\ p=L . ,P, is 
delivered. 

While the particular embodiment of the invention has been described, it will be apparent to 
those skilled in the art that various modifications may be made in the embodiment without 
departing fi*om the spirit of the present invention. Such modifications are all within the scope of 
this invention. 



